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(54) SOUD-STATE IMAGE PICKUP ELEMENT, SIGNAL PROCESSING METHOD 
THEREFOR AND CAMERA SYSTEM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To shorten signal 
processing time by providing the color filter of M 
rows X N columns, for which the two unit arrays 
of 2 X 2 for which first and second colors and 
first and third colors are arrayed in a checkered 
pattern, are arrayed in the checkered pattern. 
SOLUTION: At the upper part of an image 
pickup area 17, where sensor parts 1 1 are 
arrayed in a two-dimensional matrix, the color 
filter of prescribed color coding is formed by 
allocating one color to a sensor part 1 1 . That is, 
it is turned to the color filter of the color coding 
of M rows X N columns, for which the unit 
arrays of 2 X 2 for which green and red and 
green and blue are respectively arrayed in the 
checkered pattern are arrayed in a checkered 

pattern. Then, at signal charge transfer from a vertical CCD to a horizontal CCD, 
the two pixels of the same color are added obliquely. A unit charge, for which the 
signal charge of the obliquely added two pixels is a unit, is transferred horizontally 
in the horizontal CCD 14, converted to a voltage in a charge detection part 15 and 
then outputted from an output circuit 16. This is repeated for every two rows. 
Thus, addition signals are considered as signals from two image pickup element, 
the interpolation processing of only two colors is sufficient, and processing time is 
shortened. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 

[Claim(s)] 

[Claim 1]A solid state image pickup device comprising: 

Unit arrangement of 2x2 by which the 1st color and 2nd color were arranged in 
checkers. 

A light filter of an M line N sequence (both M and N are two or more integers) in 
which it comes in checkers to arrange both unit arrangement of 2x2 by which the 
1st color and 3rd color were arranged in checkers. 

[Claim 2]Unit arrangement of 2x2 by which the 1st color and 2nd color were 
arranged in checkers is arranged in checkers, And a solid state image pickup 
device with which the 1st color and 3rd color are characterized by unit 
arrangement of 2x2 arranged in checkers having a light filter of an M line N 
sequence (both M and N are two or more integers) which stripe shape comes to 
arrange. 

[Claim 3]A signal processing method of a solid state image pickup device which has 
a light filter of an M line N sequence (both M and N are two or more integers) in 
which it consists of combination of the 1st, 2nd, and 3rd colors, and the 1st color 
serves as arrangement of a 2-pixel repetition perpendicularly at least 
characterized by comprising the following. 

A signal from the 1st image sensor that has an M/2 line N/2 row light filter in 
which it comes to arrange only the 1 st color in a signal acquired by adding a signal 
of 2 pixels of same colors of said solid state image pickup device. 
An M/2 line N/2 row light filter in which it comes to arrange the 2nd and 3rd color. 

[Claim 4]A signal processing method of the solid state image pickup device 
according to claim 3 which said solid state image pickup device is a charge transfer 
type image sensor, and is characterized by adding a signal of 2 pixels of same 
colors in the charge transfer section. 

[Claim 5]A signal processing method of the solid state image pickup device 
according to claim 3 consisting of two image sensors characterized by comprising 
the following. 

An M/2 line N/2 row light filter in which it comes to arrange only the 2nd color as 
for said 2nd image sensor. 

An M/2 line N/2 row light filter in which it comes to arrange only the 3rd color. 
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[Claim 6]A signal processing method of the solid state image pickup device 
according to claim 3 regarding it as a signal characterized by comprising the 
following from the 2nd image sensor, and processing. 

Unit arrangement of 2x2 by which the 1st color and 2nd color were arranged in 
checkers as for a light filter of said solid state image pickup device. 
A signal from the 1st image sensor that has an M/2 line N/2 row light filter in 
which it comes in checkers to arrange both unit arrangement of 2x2 by which the 
1st color and 3rd color were arranged in checkers, and comes to arrange only the 
1st color in said signal acquired by adding. 

An M/2 line N/2 row light filter in which it comes to arrange the 2nd and 3rd color 
in checkers. 

[Claim 7]A signal processing method of the solid state image pickup device 
according to claim 6, wherein green and the 2nd color have [ red and the 3rd 
color ] the 1st blue color. 

[Claim 8]A signal processing method of the solid state image pickup device 
according to claim 6 with which the 1st color is characterized by green and the 
2nd color being [ yellow and the 3rd color ] cyanogen. 

[Claim 9]A signal processing method of the solid state image pickup device 
according to claim 6 with which the 1st color is characterized by a white and the 
2nd color being [ yellow and the 3rd color ] cyanogen. 

[Claim 10]A signal processing method of the solid state image pickup device 
according to claim 3 regarding it as a signal characterized by comprising the 
following from the 2nd image sensor, and processing. 

As for a light filter of said solid state image pickup device, unit arrangement of 2x2 
for which the 1 st color and 2nd color were arranged in checkers is arranged in 
checkers, And a signal from the 1st image sensor that has an M/2 line N/2 row 
light filter in which stripe shape comes to arrange unit arrangement of 2x2 by 
which the 1st color and 3rd color were arranged in checkers, and it comes to 
arrange only the 1st color in said signal acquired by adding. 

An M/2 line N/2 row light filter in which stripe shape comes to arrange the 2nd 
and 3rd color. 

[Claim 11]A signal processing method of the solid state image pickup device 
according to claim 10, wherein green and the 2nd color have [ red and the 3rd 
color ] the 1st blue color. 

[Claim 12]A signal processing method of the solid state image pickup device 
according to claim 10 with which the 1st color is characterized by green and the 
2nd color being [ yellow and the 3rd color ] cyanogen. 

[Claim 13]A signal processing method of the solid state image pickup device 
according to claim 10 with which the 1st color is characterized by a white and the 
2nd color being [ yellow and the 3rd color ] cyanogen. 

[Claim 14]A signal processing method of the solid state image pickup device 
according to claim 3 regarding it as a signal characterized by comprising the 
following from the 2nd image sensor, and processing. 
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As for a light filter of said solid state image pickup device, unit arrangement of 2x2 
for which the 1st color and 2nd color were arranged by stripe shape is arranged by 
stripe shape, And a signal from the 1st image sensor that has an M/2 line N/2 row 
light filter in which stripe shape comes to arrange unit arrangement of 2x2 by 
which the 1st color and 3rd color were arranged by stripe shape, and it comes to 
arrange only the 1st color in said signal acquired by adding. 

An M/2 line N/2 row light filter in which stripe shape comes to arrange the 2nd 
and 3rd color. 

[Claim 15]A signal processing method of the solid state image pickup device 
according to claim 14, wherein green and the 2nd color have [ red and the 3rd 
color ] the 1st blue color. 

[Claim 16]A signal processing method of the solid state image pickup device 
according to claim 14 with which the 1st color is characterized by green and the 
2nd color being [ yellow and the 3rd color ] cyanogen. 

[Claim 17]A signal processing method of the solid state image pickup device 
according to claim 14 with which the 1st color is characterized by a white and the 
2nd color being [ yellow and the 3rd color ] cyanogen. 

[Claim 18]A signal processing method of the solid state image pickup device 
according to claim 3 regarding it as a signal characterized by comprising the 
following from the 2nd image sensor, and processing. 

As for a light filter of said solid state image pickup device, unit arrangement of 2x2 
for which the 1st color and 2nd color were arranged by stripe shape is arranged in 
checkers, And a signal from the 1 st image sensor that has an M/2 line N/2 row 
light filter in which it comes in checkers to arrange unit arrangement of 2x2 by 
which the 1st color and 3rd color were arranged by stripe shape, and comes to 
arrange only the 1st color in said signal acquired by adding. 

An M/2 line N/2 row light filter in which it comes to arrange the 2nd and 3rd color 
in checkers. 

[Claim 19]A signal processing method of the solid state image pickup device 
according to claim 18, wherein green and the 2nd color have [ red and the 3rd 
color] the 1st blue color. 

[Claim 20]A signal processing method of the solid state image pickup device 
according to claim 18 with which the 1st color is characterized by green and the 
2nd color being [ yellow and the 3rd color ] cyanogen. 

[Claim 21]A signal processing method of the solid state image pickup device 
according to claim 18 with which the 1st color is characterized by a white and the 
2nd color being [ yellow and the 3rd color ] cyanogen. 
[Claim 22]A camera system comprising: 

A solid state image pickup device which has a light filter of an M line N sequence 
(both M and N are two or more integers) in which it consists of combination of the 
1st, 2nd, and 3rd colors, and the 1st color serves as arrangement of a 2-pixel 
repetition perpendicularly at least. 

A signal from the 1st image sensor that has an M/2 line N/2 row light filter in 
which it comes to arrange only the 1st color in a signal acquired by adding a signal 
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of 2 pixels of same colors of said solid state image pickup device. 
A signal processing means which it considers that is a signal from the 2nd image 
sensor that has an M/2 line N/2 row light filter in which it comes to arrange the 
2nd and 3rd color, and is processed. 

A recording device which records an output signal of said signal processing means. 

[Claim 23]The camera system according to claim 22 which said solid state image 
pickup device is a charge transfer type image sensor, and is characterized by 
adding a signal of 2 pixels of same colors in the charge transfer section. 



[Translation done.] 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention about a solid state image pickup device, its 
drive method, and a camera system, Especially, consist of combination of the 1 st, 
2nd, and 3rd colors, and the 1st color repeats 2 pixels perpendicularly at least. It is 
related with the camera system using a solid state image pickup device which has 
a light filter of the M line N sequence (both M and N are two or more integers) 
used as the arrangement of (calling vertical 2 repetitions hereafter), a signal 
processing method for the same, and the solid state image pickup device 
concerned as an imaging device. 
[0002] 

[Description of the Prior Art]The image sensor (a CCD image sensor is only called 
hereafter) of the solid state image pickup device (Charge Coupled Device), for 
example, CCD etc., is used as an imaging device of a digital still camera. And in the 
digital still camera, the color CCD image sensor of the multi pixel is adopted more 
for high-resolution-izing. 
[0003] 

[Problem(s) to be Solved by the Invention] However, the following problems have 
come out with multi-pixel-izing of a color CCD image sensor. That is, according to 
there being many ** pixel numbers, since signal processing takes time, the 
response of a camera worsens. For example, although the thing of color coating 
shown in drawing 18 is most adopted as a light filter of a CCD image sensor, since 
only one chrominance signal is acquired from one pixel, it is necessary to perform 
interpolation processing from the surrounding pixel, and the load is dramatically 
large. 

** According to there being much data volume, while the record time to recording 
media, such as a memory and a floppy (registered trademark) disk, becomes long, 
the record number of sheets to the recording medium concerned decreases. In 
order to increase the record number of sheets to a recording medium, the 
compression ratio of a picture must be raised, and when a compression ratio is 
raised, on the other hand, degradation of image quality will be caused. 
[0004]in light of the above-mentioned problems, this invention comes out. The 
purpose is to provide the signal processing method and camera system of a solid 
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state image pickup device which enabled shortening of the record time to the solid 
state image pickup device and recording medium which enabled shortening of time, 
and the increase in the record number of sheets to a recording medium. 

[0005] 

[Means for Solving the Problem]Unit arrangement of 2x2 by which the 1st color 
and 2nd color were arranged in checkers as for a solid state image pickup device 
by this invention, The 1st color and 3rd color have composition that both unit 
arrangement of 2x2 arranged in checkers has a light filter of an M line N sequence 
(both M and N are two or more integers) which it comes to arrange in checkers. 
[0006]As for other solid state image pickup devices by this invention, unit 
arrangement of 2x2 for which the 1st color and 2nd color were arranged in 
checkers is arranged in checkers, And unit arrangement of 2x2 by which the 1st 
color and 3rd color were arranged in checkers has composition of having a light 
filter of an M line N sequence (both M and N are two or more integers) which 
stripe shape comes to arrange. 

[0007]In these solid state image pickup devices, the signals of 2 pixels of same 
colors of a certain line and following line can be added by shifting to a column 
direction by 1 pixel by having a light filter of the above-mentioned color coding. It 
becomes possible to regard it as a signal from the 1 st image sensor that has an 
M/2 line N/2 row light filter in which it comes to arrange only the 1st color, and a 
signal from the 2nd image sensor that has an M/2 line N/2 row light filter in which 
it comes to arrange the 2nd and 3rd color, and to process by this summing 
processing. That is, in spite of being a signal from one solid state image pickup 
device, it can process as a signal from two or more image sensors. 
[0008]A signal processing method by this invention consists of combination of the 
1st, 2nd, and 3rd colors, And in a solid state image pickup device which has a light 
filter of an M line N sequence (both M and N are two or more integers) in which 
the 1st color serves as arrangement of a 2-pixel repetition perpendicularly at least, 
A signal from the 1st image sensor that has an M/2 line N/2 row light filter in 
which it comes to arrange only the 1 st color in a signal acquired by adding a signal 
of 2 pixels of same colors of this solid state image pickup device, It is regarded as 
a signal from the 2nd image sensor that has an M/2 line N/2 row light filter in 
which it comes to arrange the 2nd and 3rd color, and is made to carry out signal 
processing. 

[0009]By such signal processing, in spite of being a signal from one solid state 
image pickup device, it can process as a signal from two or more image sensors. 
As a result, since there is little work of interpolation processing and it ends, time 
which signal processing takes can be shortened. And since an interval of a pixel 
and a pixel to interpolate becomes narrow, as data, it can contribute to high 
definition-ization of M/2 line N/2 row and a decreasing thing. 

[001 0]A camera system by this invention consists of combination of the 1st, 2nd, 
and 3rd colors, And a solid state image pickup device which has a light filter of an 
M line N sequence (both M and N are two or more integers) in which the 1st color 
serves as arrangement of a 2-pixel repetition perpendicularly at least, A signal 
from the 1st image sensor that has an M/2 line N/2 row light filter in which it 



JP,2000-197066,A [DETAILED DESCRIPTION] 



3/5 ^-V 



comes to arrange only the 1st color in a signal acquired by adding a signal of 2 
pixels of same colors of this solid state image pickup device, It has composition 
provided with a signal processing means which it considers that is a signal from the 
2nd image sensor that has an M/2 line N/2 row light filter in which it comes to 
arrange the 2nd and 3rd color, and is processed, and a recording device which 
records an output signal of this signal processing means. 

[001 1]In a camera system of the above-mentioned composition, the signals of 2 
pixels of same colors can be added by having a light filter of color coding of the 
above [ a solid state image pickup device ]. And a signal from the 1st image sensor 
that has an M/2 line N/2 row light filter in which it comes to arrange only the 1st 
color in this signal acquired by adding, It is regarded as a signal from the 2nd image 
sensor that has an M/2 line N/2 row light filter in which it comes to arrange the 
2nd and 3rd color, and processes, namely, a signal from one solid state image 
pickup device is processed as a signal from two or more image sensors. 
[0012]As a result, since there is little work of interpolation processing and it ends, 
time which signal processing takes can be shortened, and a thing which decreases 
with M/2 line N/2 row as data since an interval of a pixel and a pixel to interpolate 

becomes narrow — high definition izing can do. According to there being little 

data, while being able to shorten the record time to a recording medium, record 

number of sheets to a recording medium can be increased. 

[0013] 

[Embodiment of the Invention] Hereafter, an embodiment of the invention is 
described in detail with reference to drawings. Drawing 1 is an outline lineblock 
diagram showing the color CCD image sensor of an interline transfer (IT) method, 
for example, this invention is applied. 

[0014]In drawing 1 , many sensor parts (pixel) 11 which change and accumulate 
incident light in the signal charge of charge quantity according to the light volume 
are arranged in the vertical (line) direction and the level (sequence) direction at 
two-dimensional matrix form. Two or more vertical CCD 12 are provided for every 
vertical file of these sensor parts 11, and the read gate part 13 intervenes between 
these vertical CCD12 and each sensor part 11 further. 

[0015]The read pulse XSG mentioned later is impressed to the read gate part 13, 
and the signal charge accumulated in two or more sensor parts 1 1 is read to 
vertical CCD12, when the potential of the read gate part 13 concerned becomes 
deep. A transmission drive is carried out, for example by the vertical transfer 
clocks VphM to Vphi4 of four phases, and vertical CCD12 carries out vertical 
transfer of the read signal charge to order. 

[0016]In vertical CCD12, the transfer electrode of a plane 1 eye and a three- 
phase-circuit eye usually has structure which served as the gate electrode of the 
read gate part 13. From this, the vertical transfer clocks VphM of a plane 1 eye 
and the vertical transfer clocks Vphi3 of a three-phase-circuit eye among the 
vertical transfer clocks Vphil to Vphi4 of four phases A low, It is set up take the 
ternary of an intermediate level and a high level, and the pulse of a high level of 
the ternary eye turns into the read pulse XSG impressed to the read gate part 13. 
[001 7]The end by the side of each two or more destinations of vertical CCD 12 was 
adjoined, and level CCD14 has extended in the longitudinal direction of a figure. 
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The signal charge equivalent to vertical CCD12 to two or more one of line (one 
scanning line) is transmitted to this level CCD14 one by one. A transmission drive 
is carried out by the horizontal transfer clock HphM of two phases, and Hphi2, for 
example, and level CCD14 carries out horizontal transfer of the signal charge for 
one line by which the line shift was carried out from two or more vertical CCD12 
one by one. 

[0018]The charge detector 15 of floating diffusion amplifier composition is allotted 
to the end by the side of the destination of level CCD14, for example. This charge 
detector 15 consists of reset gate RG located between floating diffusion FD, reset 
drain RD, and both, changes into a signal level the signal charge in which horizontal 
transfer has been carried out by level CCD14 one by one, and outputs it. 
[001 9]The reset drain voltage VRD is given to reset drain RD in this charge 
detector 15. And the reset action which discharges the electric charge in floating 
diffusion FD to reset drain RD is performed by impressing reset gate pulse phiRG 
to reset gate RG. In floating diffusion FD, a signal charge is changed into a signal 
level and this signal level serves as a CCD output via the output circuit 16. 
[0020]By the way, since the CCD image sensor of the above-mentioned 
composition is a thing of a color imaging method, the sensor part 1 1 above the 
image pick-up area 17 which two-dimensional matrix form comes to arrange. 
[ many ] The light filter (not shown) of predetermined color coding is ******(ed) 
on chip so that one color may be assigned to the one sensor part (pixel) 1 1 . 
Concrete color coding of this light filter is one of the features of this invention, and 
that example is later mentioned for it. 

r0021] Drawing 2 is an outline lineblock diagram showing the camera system 
concerning this invention which used the color CCD image sensor of the above- 
mentioned composition as an imaging device, for example. The optical system 
which contains color CCD image sensor 21 in which this camera system is an 
imaging device, and the lens 22 in drawing 2 , Various kinds of timing pulses. The 
image display device 26 which displays the output signal of the timing pulse 
generating circuit 23 to generate, the digital disposal circuit 24 which processes 
the output signal of CCD image sensor 21, the image recorder 25 which records 
the output signal of this digital disposal circuit 24 on a recording medium, and the 
digital disposal circuit 24 on an indicator. It has composition which it had. 
[0022]In the camera system of the above-mentioned composition, on the imaging 
surface of CCD image sensor 21, it lets the optical system containing the lens 22 
and the light filter which carried out point ** pass, and image formation of the 
incident light (image light) from a photographic subject (not shown) is carried out. 
CCD image sensor 21 by various kinds of timing pulses phiV1 to phiV4 suitably 
outputted from the timing pulse generating circuit 23, for example, the vertical 
transfer pulse of four phases, the horizontal transfer pulse phiH1 of two phases, 
phiH2, the read pulse XSG, etc. The drive of read-out of the signal charge from a 
pixel, vertical transfer, horizontal transfer, etc. is performed. 

[0023]The signal from one CCD image sensor 21 is regarded as a signal from two 
or more image sensors, and the digital disposal circuit 24 processes it. The signal 
processing method in this digital disposal circuit 24 is also one of the features of 
this invention, and that example is later mentioned for it. The image recorder 25 
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records the picture signal processed in the digital disposal circuit 24 on recording 
media, such as a memory, a floppy disk, and magnetic tape. The image display 
device 26 displays the picture signal processed in the digital disposal circuit 24 on 
indicators, such as CRT (cathode-ray tube) and LCD (liquid crystal). 
[0024]Next, the example of the signal processing method in the example of color 
coding of a light filter and the digital disposal circuit 24 accompanying it is 
explained. 

[0025][The 1st example] Drawing 3 is a figure showing the 1st example of color 
coding. In the light filter 31 concerning this 1st example. The unit arrangement of 
the vertical 2x level 2 (it is only hereafter described as 2x2) by which green (G) 
and red (R) were arranged in checkers so that clearly from drawing 3 , Both green 
and the unit arrangement of 2x2 by which blue (B) was arranged in checkers serve 
as color coding of the M line N sequence (both M and N are two or more integers) 
which it comes to arrange in checkers. 

[0026]In CCD image sensor 21 which has the light filter 31 concerning this 1st 
example. Processing which carries out slanting addition (they are G1 comrades, R1 
comrades, and B~2s in drawing 3 ) of the 2-pixel signal charge of the same color in 
the case of transmission (V-H transmission is called hereafter) of the signal charge 
from vertical CCD12 to level CCD14 shown in drawing 1 is performed. 
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DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 

[Drawing 1]It is an outline lineblock diagram showing the color CCD image sensor 
of the interline transfer method with which this invention is applied. 
[Drawing 2] It is an outline lineblock diagram showing the camera system 
concerning this invention. 

[Drawing 3 ] It is a figure showing color coding of the primary colors filter 
concerning the 1st example. 

[Drawing 4] It is an explanatory view of operation showing the procedure of slanting 
2 pixel addition. 

[Drawing 5] It is a figure showing color coding by signal processing concerning the 
1 st example. 

[Drawing 6] It is a figure showing color coding of the complementary filter 
concerning the 1st example. 

[Drawing 7]It is a figure showing color coding of the primary colors filter 
concerning the 2nd example. 

[Drawin g 8]It is a figure showing color coding by signal processing concerning the 
2nd example. 

[Drawing 9]It is a figure showing color coding of the complementary filter 
concerning the 2nd example. 

[Drawing 10] It is a figure showing color coding of the primary colors filter 
concerning the 3rd example. 

[Drawin g 1 1]It is a figure showing color coding by signal processing concerning the 
3rd example. 

[Drawing 1 2] It is a figure showing color coding of the complementary filter 
concerning the 3rd example. 

[Drawing 13]It is a figure showing color coding of the primary colors filter 
concerning the 4th example. 

[Drawing 14] It is a figure showing color coding by signal processing concerning the 
4th example. 

[ Drawing 1 5]It is a figure showing color coding of the complementary filter 
concerning the 4th example. 

[Drawing 16] It is a figure showing color coding of the primary colors filter 
concerning the 5th example. 
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[ Drawing 1 7] It is a figure showing color coding by signal processing concerning the 
4th example. 

fDrawing 18] It is a figure showing color coding of a common light filter. 
[Description of Notations] 

11 [ — A charge detector, 21 / — A CCD image sensor, 24 / — A digital disposal 
circuit, 25 / — An image recorder, 26 / — An image display device, 31-35 / — 
Light filter ] — A sensor part, 12 — Vertical CCD, 14 — Level CCD, 15 



[Translation done.] 
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